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Abstract — In this paper, the problem of assigning channel slots 
to a number of contending stations is modeled as a Constraint 
Satisfaction Problem (CSP). A learning MAC protocol that uses 
deterministic backoffs after successful transmissions is used as 
a decentralized solver for the CSP. The convergence process of 
the solver is modeled by an absorbing Markov chain (MC), and 
analytical, closed-form expressions for its transition probabilities 
are derived. Using these, the expected number of steps required 
to reach a solution is found. The analysis is validated by means of 
simulations and the model is extended to account for the presence 
of channel errors. The results are applicable in various resource 
allocation scenarios in wireless networks. 

Index Terms — Medium Access Control, decentralized con- 
straint satisfaction solver, learning MAC protocol 



I. Introduction 

SINCE the inception of wireless local area networks 
(WLANs), random medium access mechanisms have 
played a key role in arbitrating access to shared channels. The 
core principles of the medium access control (MAC) that were 
introduced in the first release of the IEEE 802.11 standard 
are still valid today |[T1. The contenders for the channels use 
carrier sense to avoid interrupting ongoing transmissions. Until 
recently, slotted time combined with a random backoff have 
been used to reduce the chances that two stations simulta- 
neously start a transmission. However, it was pointed out 
recently that the random choice of the backoff value is not 
necessary after successful transmissions Q. In fact, if all the 
nodes that have successfully transmitted choose a common 
deterministic backoff value for their next transmission, the 
chances of collisions are reduced, since in their next transmis- 
sion they may only collide with the remaining unsuccessful 
nodes. Furthermore, under certain conditions, a collision-free 
operation can be reached and maintained. 

The idea of using a deterministic backoff after successful 
transmissions has been explored in more detail in, e.g., fS)- 
161. The goal of this class of protocols is to distributively build 
a collision-free schedule which can then repeat periodically 
without further collisions, as long as the network does not 
change. This is equivalent to the decentralized assignment of 
stations to slots within one period of the schedule in such a 
way that no slot is assigned to more than one station. Such an 
assignment is obtainable if the number of contending stations 
does not exceed the number of slots in one period of the 
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schedule. We are interested in forecasting the expected number 
of rounds required to reach a collision-free assignment. 

Similar problems can be found in other areas of networking 
where limited resources need to be distributed among a group 
of stations. Examples of such resources include channel time 
slots 121, frequency channels Q, and code division multiple 
access scramble codes [S). 

In Q, a general framework is presented that encompasses 
problems such as graph coloring, channel assignment to 
WLANs cells, the search for feasible inter-flow codes in net- 
work coding, and the construction of collision-free schedules 
in CSMA networks. This framework consists in modeling 
the resource-assignment problem as a Constraint Satisfaction 
Problem (CSP) ||9|. When the nodes fliat participate in the CSP 
cannot communicate with one another to solve the problem, 
a decentralized approach is required. Decentralized solvers 
are different from distributed solvers ifTOl . which require 
message exchange among the participating nodes. The concept 
of decentralized CSP solvers is very recent and is yet to be 
explored in depth. In Q, a decentralized solver for this CSP 
is presented and analyzed, and a bound on the convergence 
time of the solver is found. 

In this work, we focus on analyzing a MAC protocol 
that uses deterministic backoffs after successful transmis- 
sions, however, our results are applicable for many other 
distributed resource-allocation problems. Similarly to Q, we 
model the channel access problem as a CSP for which the 
aforementioned protocol serves as a decentralized solver To 
calculate the expected number of rounds the solver requires 
to reach a solution, we model the convergence process using 
an absorbing Markov chain (MC). The first contribution of 
this paper is the derivation of closed-form expressions for 
transition probabilities of the absorbing MC, which are then 
used to calculate the expected convergence time of the solver 
The second contribution is the adaptation of the model to an 
environment in which errors can occur 

II. System Model and the Corresponding CSP 

We consider a wireless network in which channel time 
is slotted. The slots are grouped in rounds, and each round 
contains B consecutive slots. Our focus is on the distributed 
assignment of N contending wireless stations to the B channel 
time slots per round. In each round, each stations randomly 
selects one of the B slots in the round. In each slot a single 
transmission can be completed and acknowledged. A station 
succeeds if the slot it has chosen is not selected by any other 
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Station, in which case its transmission is acknowledged in 
the same slot. If two or more stations pick the same slot, 
all stations involved will suffer a colhsion, in which case no 
acknowledgment will be received. 

A. The Constraint Satisfaction Problem 

A CSP is simply a problem consisting of a set of 
variables whose value must satisfy a set of constraints. 
Adopting the notation from Q, we consider variables, 
X := (xi, . . . , xjv), with Xi € B = {!,..., B} , Vi, and M 
clauses, {$i(x), . . . , $ji/(x)}, that are Boolean functions. The 
M clauses represent the constraints and take a value equal to 1 
if the constraint is satisfied and otherwise. An assignment x 
is a solution to the problem if all the constraints are satisfied. 

For our system model, the variables {xi}^^ ™ 'he cor- 
responding CSP are the slots chosen by the N contending 
wireless stations from the set of available slots B in every 
round. There is one clause per pair of variables evaluating if 
they have the same value or not. The clause will return if 
the two participating stations have selected the same slot (i.e., 
a collision) and returns 1 otherwise. 

B. The Decentralized Solver 

Here we describe a protocol that distributively solves the 
problem posed above, whenever a solution exists. The con- 
tention is organized in transmission rounds that contain B 
transmission slots. In every round, each of the N stations 
transmit exactly once. A solution to the problem is an as- 
signment in which no slot contains more than one wireless 
stations. The protocol describes how the stations pick their 
transmission slots in each round, taking into account that each 
station is only aware of the outcome of its own transmission 
in the previous round. 

The protocol works as follows. In the first round, each 
station randomly and independently picks one of the B possi- 
ble slots in the round. If the transmission is successful, the 
station will pick exactly the same slot in the next round. 
Otherwise, it will again pick one of the B slots randomly. 
This process repeats until all stations successfully transmit in 
the same round, from which point on, all stations will transmit 
periodically and no collisions will occur The operation of this 
protocol is illustrated in Fig. [T] for five consecutive rounds. 
A collision-free solution is reached in the fourth round, after 
which the schedule is repeated endlessly without collisions. 

This protocol is a simplified version of a variant of 
CSMA/CA, called CSMA with enhanced collision avoidance 
(CSMA/ECA), as detailed in, e.g., E), ||3], E, ifTTI. 

This protocol can be viewed as a distributed solver for the 
CSP defined in the previous subsection. In the first round, the 
variables Xi are assigned a value in {1, • • • , 5} randomly, with 
probability \/B. Then the constraints are evaluated. Those 
variables that are involved in unsatisfied constraints take a 
random value again in the next round, while the rest keep 
the same value as in the previous round. When a solution is 
reached, all variables keep the same value. This solver is, in 
fact, an instance of the parameterized solver in Q, with the 
parameter values set to a = 6 = 1. An attractive property 



Slot No. 0123456789 



16 17 18 19 20 21 22 23 24 25 



32 33 34 35 36 37 38 39 40 41 



48 49 50 51 52 53 54 55 56 57 



10 11 12 13 14 15 



26 27 28 29 30 31 



42 43 44 45 46 47 



58 59 60 61 62 63 



64 65 66 67 68 69 70 71 72 73 74 75 76 77 79 79 
Fig. L CSMA/ECA contention 



of this decentralized solver is that it reaches the solution in 
finite time, if it exists, and its performance is comparable to 
the known centralized solvers such as WalkSAT lfT2ll . 

III. The Markov Chain Model 

We are interested in calculating the expected number of 
rounds required to reach a solution. To this end, we construct 
a Markov chain to model the behavior of the protocol (or 
equivalently, the CSP solver). 

By the pigeonhole principle, a solution exists only when 
N < B, i.e., when there are at least as many slots in a 
round as the total number of stations. Considering N < B 
contending stations, the associated MC model has + 1 
different states, So,...,Sn- The system is in state Sd if 
exactly d stations (0 < d < N) were successful in the 
previous round and, therefore, will deterministically choose 
their transmission slot in the current round. From the CSP 
perspective, this is equivalent to saying that there are exactly 
d variables that were not involved in any constraint that was 
not satisfied in the previous round. 

We are interested in the computation of the transition 
probability, p^'^ , from one state Sd to another state Sg, 
Q < 5 < N. In other words, p^i'^ is the probability of 
obtaining 5 successful transmissions given N stations and B 
slots when d of the stations use a deterministically chosen slot 
while the remaining N — d stations transmit in a randomly 
chosen slot. 



Note that the considered MC is an absorbing MC, as 
TV ~ 1- 'This is because, once a collision-free schedule is 
found, the same collision-free schedule is repeated in every 
subsequent step. Since the MC is absorbing, the expected 
number of steps before convergence can be computed if the 
values of p^'^ are known ifTSll . 

A. Calculating the Transition Probabilities 

To calculate the transition probabilities, we number the 
stations from 1 to and define Ai to be the event that station 
i succeeds, and the set A = {Ai]f^^ to be the collection of 
all such events. These events are partially overlapping since 
more than one station may successfully transmit in the same 
round. For a given d, the transition probability p^'^ is the 
probabihty that exactly 5 out of the A^ events in A happen. As 
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mentioned before, when d ~ N, the system is in the absorbing 
state Sn, and p^'^ = 1, when 6 = N, and is zero otherwise. 
When d < N, this probabiUty can be calculated applying a 
generalized version of the inclusion-exclusion principle (see, 
e.g., the theorem in Sec. IV.3 of 1141 ) as follows: 



N 
3=S 



(1) 



where S{j) is given by 



sij)= E 



VA3CA 




(2) 



Here denotes a subset of A that has exactly j elements, 
i.e., jA^ I = j. Therefore, PrlPlyi gaj probability 
that all the j stations represented in A^ successfully transmit. 
Note that S{j) is a sum of probabilities, but it is not itself a 
probability. 

For a given set of j tagged stations in A^ , the probability 
P^jri/i eA3 ^i} depends on k, the number of deterministic 
stations within the j tagged stations. The j tagged stations 
succeed if the j — k random stations among them choose 
unoccupied slots, and the remaining N — d—{j — k) untagged 
random stations choose slots that are different from the ones 
selected by the j tagged stations. The first event occurs with 
probability 

- d\ {j-k)l 
j-k) Bi-^ ' 



and the second with probability 



B 



B 
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When j = N, we have k = d, and therefore, there are no 
untagged random stations, hence the second probability is 1. 
Consequently, the probability that all of the j stations of A-* 
succeed, given that k of them are deterministic, after some 
simplification is 



(3) 
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{B-d)l 
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j < N 



N 



For any given j, there are (^) {'^^l!) sets A-* with k de- 
terministic stations. Furthermore, the number of deterministic 
stations, k, among the j tagged stations is bounded by 



max(0, J + d — N) < k < min((i, j), 



(4) 



since in a set of j nodes, there cannot be more deterministic 
stations than the total number of deterministic stations (fc < 
d), or more random stations than the total number of random 
stations {j — k < N — d). 



Using Q, (O, and (HI, S{j) can be calculated as 

min(dj) 

sij) = E 

k=ma,x(0,j+d-N) 

{B - dy.{B - 



d\ - d 
k)[j-k 



(5) 



and for j — N, 



SiN) 



{B-d-{j-k)y. B^-'i 
[B - dy 



(6) 



(B-iV)! BN-<^' 

Finally, the transition probabilities for d < N can be calculated 
by replacing S{j) in ([T]). When d = Q, i.e., when all the 
stations randomly select a slot, this result exactly matches the 
one obtained in ifTsll . 

B. Calculating the Number of Steps until Absorption 

To compute the expected number of rounds needed for the 
solver to reach a solution, we calculate the expected number 
of transitions that the MC takes to reach the absorbing state 
Sn (see, e.g., lfT3l for the theory behind this calculation). 

Let P^'^ be the transition probability matrix of the MC. 
This matrix is a square matrix of size 1. If we number the 
rows and columns of P^'^ starting with zero, the element in 
row d and column 5 is simply [P^'^]^ ^ = P^a^ in ([U. 
In this matrix, rows to — 1 represent transitions from the 
transient states and row N the transitions from the absorbing 
state. Therefore, P^ '^ has the following general form: 



■>B,N 
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^ Q{NxN) 
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^ O(lxW) 


' J 



(7) 



where Q is a matrix containing the first rows and columns 
of P^'^, from which we calculate the fundamental matrix of 
the absorbing MC as N = {Inxn — Q)~^, where Inxn is 
the N X N identity matrix. The expected number of steps to 
absorption, if the system starts in state 5*0, is the sum of all 
the elements in the first row of N. 

C. The Markov Chain in the Presence of Channel Errors 

So far we have not considered the possibility that the 
channel introduces errors. In presence of channel errors, a 
transmission may be unsuccessful even if it has not suffered a 
collision. In fact, after an unsuccessful transmission, a wireless 
station cannot know whether it has suffered a collision or a 
channel error, and the response of the protocol will be exactly 
the same, i.e., moving the station back to the random behavior 

In this case, the probability of moving from the state Sd 
to the state Ss is the probability that i G [6, N] stations do 
not collide, but exactly i — (5 of those stations suffer a channel 
error, i.e.. 



B.N., 
Pd.S 



N , . 

EI''" 

i=8 ^ 



(1-6)^ 



■,N 



(8) 



where e is the channel error probability. Note that the resulting 
MC is no longer absorbing. 
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Fig. 2. The analytically computed expectation is compared to simulation 
averages. Two different values for B have been considered (B = S and 
B = 16) and N takes values from 2 to 16. 



Fig. 3. The average number of successful transmissions in every round 
obtained from simulation is compared to the analytically computed expected 
values. 



IV. Numerical Results 

In this section we present simulation results that validate 
the expressions derived in the previous section. The number 
of slots in each round is set to i? = 8 and B — IQ, 
and the number of contenders N takes values from 2 to 
16. The contenders choose the same slot in the case of 
successful transmission and a random slot if the transmission 
is unsuccessful. 

The first results are for an ideal channel that does not intro- 
duce errors. We compare the analytically computed expected 
number of steps to absorption and the average number of 
steps to reach collision-free operation obtained from 10,000 
executions of a custom simulatorQ The results are presented 
in Fig. |2] 

To validate the expression in dHJ we compute the average 
number of successful transmissions in each step from the MC 
and compare it with averages obtained from a simulation of 
10,000 rounds. The results for a channel error probability e = 
0.1, different numbers of slots (B) and different numbers of 
contenders (N) are presented in Fig. [3] 

V. Conclusion 

We have studied a decentralized CSP solver to assign chan- 
nel slots to contending stations. With this solver, the system 
eventually converges to collision-free operation under ideal 
channel conditions. We have modeled the convergence process 
as an absorbing MC and have derived closed expressions for 
the transition probabilities, which are used to compute the 
expected number of steps required for the system to converge 
to a solution. We have also considered the presence of channel 
errors and constructed an MC that accounts for channel errors, 
and have calculated its transition probabilities. The presented 
results have been vaUdated by means of simulation. The results 
can be adapted to various scenarios in wireless networks where 

'The two simulators in C that we have used and the scripts in maxima 
to compute the expectations derived from the analytical model can be 
downloaded from |https://github.com/jbarcelo/source- paper- mdc | . 



a finite number of resources need to be distributively assigned 
to a number of contending stations. 
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